2025-11-13 08:44:37,892 [ 143972 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths)
2025-11-13 08:44:37,892 [ 143972 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:79, check_args_and_update_paths)
2025-11-13 08:44:37,892 [ 143972 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:90, check_args_and_update_paths)
2025-11-13 08:44:37,892 [ 143972 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration  (runner:92, check_args_and_update_paths)
clickhouse_integration_tests_volume
Running pytest container as: 'docker run   --rm --name clickhouse_integration_tests_5uemno --privileged --dns-search='.' --memory=30709026816 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf   -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600  -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10  -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel1_0.jsonl --report-log-exclude-logs-on-passed-tests 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node2]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node1]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node2]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node1]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node2]' test_executable_user_defined_functions_config_reload/test.py::test test_explain_estimates/test.py::test_explain_estimates test_external_cluster/test.py::test_ddl test_external_cluster/test.py::test_ddl_replicated test_external_http_authenticator/test.py::test_basic_auth_failed test_external_http_authenticator/test.py::test_header_failed test_external_http_authenticator/test.py::test_session_settings_from_auth_response test_external_http_authenticator/test.py::test_user_create_basic_auth_pass test_external_http_authenticator/test.py::test_user_from_config_basic_auth_pass test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]' 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]' test_filesystem_cache/test.py::test_custom_cached_disk test_filesystem_cache/test.py::test_dynamic_resize test_filesystem_cache/test.py::test_filesystem_cache_log test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges test_filesystem_cache/test.py::test_keep_up_size_ratio 'test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]' test_filesystem_cache/test.py::test_system_sync_filesystem_cache test_grpc_protocol_ssl/test.py::test_insecure_channel test_grpc_protocol_ssl/test.py::test_secure_channel test_grpc_protocol_ssl/test.py::test_wrong_client_certificate test_hot_reload_storage_policy/test.py::test_hot_reload_policy test_hot_reload_storage_policy/test.py::test_hot_reload_policy_distributed_table test_http_and_readonly/test.py::test_http_get_is_readonly test_http_native/test.py::test_http_native_returns_timezone test_inherit_multiple_profiles/test.py::test_combined_profile test_insert_distributed_async_extra_dirs/test.py::test_insert_distributed_async_send_success test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard test_insert_into_distributed_sync_async/test.py::test_insertion_sync test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout test_jbod_ha/test.py::test_jbod_ha test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin test_keeper_block_acl/test.py::test_keeper_block_acl test_keeper_compression/test_with_compression.py::test_select test_keeper_disks/test.py::test_logs_with_disks test_keeper_disks/test.py::test_snapshots_with_disks test_keeper_four_word_command/test_allow_list.py::test_allow_list test_keeper_internal_secure/test.py::test_secure_raft_works test_keeper_internal_secure/test.py::test_secure_raft_works_with_password test_keeper_memory_soft_limit/test.py::test_soft_limit_create test_keeper_mntr_pressure/test.py::test_aggressive_mntr test_keeper_nodes_move/test.py::test_node_move test_keeper_persistent_log/test.py::test_ephemeral_after_restart test_keeper_persistent_log/test.py::test_state_after_restart test_keeper_persistent_log/test.py::test_state_duplicate_restart test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout 'test_keeper_zookeeper_converter/test.py::test_acls[False]' 'test_keeper_zookeeper_converter/test.py::test_acls[True]' 'test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[False]' 'test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[True]' 'test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[False]' 'test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[True]' 'test_keeper_zookeeper_converter/test.py::test_smoke[False]' 'test_keeper_zookeeper_converter/test.py::test_smoke[True]' test_mask_sensitive_info/test.py::test_backup_table test_mask_sensitive_info/test.py::test_backup_table_AzureBlobStorage test_mask_sensitive_info/test.py::test_backup_to_s3 test_mask_sensitive_info/test.py::test_create_alter_user test_mask_sensitive_info/test.py::test_create_database test_mask_sensitive_info/test.py::test_create_dictionary test_mask_sensitive_info/test.py::test_create_table test_mask_sensitive_info/test.py::test_encryption_functions test_mask_sensitive_info/test.py::test_iceberg_cluster_function test_mask_sensitive_info/test.py::test_on_cluster test_mask_sensitive_info/test.py::test_table_function_ways_to_call test_mask_sensitive_info/test.py::test_table_functions test_mutation_fetch_fallback/test.py::test_mutation_fetch_fallback test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_ttl test_quorum_inserts/test.py::test_simple_add_replica test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]'  -vvv " altinityinfra/integration-tests-runner:226bfaf75ac1 '.
Start tests
============================= test session starts ==============================
platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3
cachedir: .pytest_cache
Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket=<bucket_type>
rootdir: /ClickHouse/tests/integration
configfile: pytest.ini
plugins: timeout-2.3.1, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0, random-order-1.1.1
timeout: 900.0s
timeout method: signal
timeout func_only: False
created: 10/10 workers
10 workers [100 items]

scheduling tests via LoadFileScheduling

test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node] 
test_reload_clusters_config/test.py::test_add_cluster 
test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] 
test_mask_sensitive_info/test.py::test_backup_table 
test_keeper_zookeeper_converter/test.py::test_acls[False] 
test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 
test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard 
test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used 
test_external_http_authenticator/test.py::test_basic_auth_failed 
test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node2] 
[gw5] [  1%] PASSED test_external_http_authenticator/test.py::test_basic_auth_failed 
test_external_http_authenticator/test.py::test_header_failed 
[gw5] [  2%] PASSED test_external_http_authenticator/test.py::test_header_failed 
test_external_http_authenticator/test.py::test_session_settings_from_auth_response 
[gw8] [  3%] PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used 
test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes 
[gw6] [  4%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node2] 
test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node1] 
[gw6] [  5%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node1] 
test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node2] 
[gw6] [  6%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node2] 
test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node1] 
[gw7] [  7%] PASSED test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard 
test_insert_into_distributed_sync_async/test.py::test_insertion_sync 
[gw6] [  8%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node1] 
test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node2] 
[gw8] [  9%] PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes 
test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk 
[gw6] [ 10%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node2] 
test_grpc_protocol_ssl/test.py::test_insecure_channel 
[gw1] [ 11%] PASSED test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node] 
test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path] 
[gw8] [ 12%] PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk 
test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin 
[gw5] [ 13%] PASSED test_external_http_authenticator/test.py::test_session_settings_from_auth_response 
test_external_http_authenticator/test.py::test_user_create_basic_auth_pass 
[gw7] [ 14%] PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync 
test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout 
[gw8] [ 15%] PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin 
[gw5] [ 16%] PASSED test_external_http_authenticator/test.py::test_user_create_basic_auth_pass 
test_external_http_authenticator/test.py::test_user_from_config_basic_auth_pass 
[gw1] [ 17%] PASSED test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path] 
test_filesystem_cache/test.py::test_custom_cached_disk 
[gw5] [ 18%] PASSED test_external_http_authenticator/test.py::test_user_from_config_basic_auth_pass 
[gw7] [ 19%] PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout 
test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout 
[gw7] [ 20%] PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout 
test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout 
test_keeper_persistent_log/test.py::test_ephemeral_after_restart 
[gw7] [ 21%] PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout 
test_external_cluster/test.py::test_ddl 
[gw3] [ 22%] PASSED test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 
test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False] 
[gw4] [ 23%] PASSED test_keeper_zookeeper_converter/test.py::test_acls[False] 
test_keeper_zookeeper_converter/test.py::test_acls[True] 
[gw3] [ 24%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False] 
test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True] 
[gw6] [ 25%] PASSED test_grpc_protocol_ssl/test.py::test_insecure_channel 
test_grpc_protocol_ssl/test.py::test_secure_channel 
[gw6] [ 26%] PASSED test_grpc_protocol_ssl/test.py::test_secure_channel 
test_grpc_protocol_ssl/test.py::test_wrong_client_certificate 
[gw6] [ 27%] PASSED test_grpc_protocol_ssl/test.py::test_wrong_client_certificate 
[gw3] [ 28%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True] 
test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 
[gw8] [ 29%] PASSED test_keeper_persistent_log/test.py::test_ephemeral_after_restart 
test_keeper_persistent_log/test.py::test_state_after_restart 
[gw5] [ 30%] PASSED test_external_cluster/test.py::test_ddl 
test_external_cluster/test.py::test_ddl_replicated 
[gw5] [ 31%] PASSED test_external_cluster/test.py::test_ddl_replicated 
[gw8] [ 32%] PASSED test_keeper_persistent_log/test.py::test_state_after_restart 
test_keeper_persistent_log/test.py::test_state_duplicate_restart 
test_keeper_internal_secure/test.py::test_secure_raft_works 
test_keeper_disks/test.py::test_logs_with_disks 
[gw2] [ 33%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] 
test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] 
[gw2] [ 34%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] 
test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 
[gw4] [ 35%] PASSED test_keeper_zookeeper_converter/test.py::test_acls[True] 
test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[False] 
[gw1] [ 36%] PASSED test_filesystem_cache/test.py::test_custom_cached_disk 
[gw2] [ 37%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 
test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] 
[gw2] [ 38%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] 
test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] 
test_filesystem_cache/test.py::test_dynamic_resize 
[gw8] [ 39%] PASSED test_keeper_persistent_log/test.py::test_state_duplicate_restart 
[gw2] [ 40%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] 
test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] 
test_hot_reload_storage_policy/test.py::test_hot_reload_policy 
test_keeper_session/test.py::test_session_close_shutdown 
[gw3] [ 41%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 
test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False] 
[gw1] [ 42%] PASSED test_filesystem_cache/test.py::test_dynamic_resize 
test_filesystem_cache/test.py::test_filesystem_cache_log 
[gw2] [ 43%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] 
[gw3] [ 44%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False] 
test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True] 
[gw1] [ 45%] PASSED test_filesystem_cache/test.py::test_filesystem_cache_log 
test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges 
[gw4] [ 46%] PASSED test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[False] 
test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[True] 
[gw3] [ 47%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True] 
test_quorum_inserts/test.py::test_insert_quorum_with_ttl 
[gw7] [ 48%] PASSED test_hot_reload_storage_policy/test.py::test_hot_reload_policy 
test_hot_reload_storage_policy/test.py::test_hot_reload_policy_distributed_table 
[gw0] [ 49%] PASSED test_mask_sensitive_info/test.py::test_backup_table 
test_mask_sensitive_info/test.py::test_backup_table_AzureBlobStorage 
[gw0] [ 50%] PASSED test_mask_sensitive_info/test.py::test_backup_table_AzureBlobStorage 
test_mask_sensitive_info/test.py::test_backup_to_s3 
[gw6] [ 51%] PASSED test_keeper_internal_secure/test.py::test_secure_raft_works 
test_keeper_internal_secure/test.py::test_secure_raft_works_with_password 
test_explain_estimates/test.py::test_explain_estimates 
[gw7] [ 52%] PASSED test_hot_reload_storage_policy/test.py::test_hot_reload_policy_distributed_table 
[gw8] [ 53%] PASSED test_keeper_session/test.py::test_session_close_shutdown 
test_keeper_session/test.py::test_session_timeout 
[gw8] [ 54%] PASSED test_keeper_session/test.py::test_session_timeout 
test_http_and_readonly/test.py::test_http_get_is_readonly 
[gw3] [ 55%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_ttl 
test_quorum_inserts/test.py::test_simple_add_replica 
test_http_native/test.py::test_http_native_returns_timezone 
[gw5] [ 56%] PASSED test_keeper_disks/test.py::test_logs_with_disks 
test_keeper_disks/test.py::test_snapshots_with_disks 
[gw4] [ 57%] PASSED test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[True] 
test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[False] 
[gw3] [ 58%] PASSED test_quorum_inserts/test.py::test_simple_add_replica 
[gw7] [ 59%] PASSED test_http_and_readonly/test.py::test_http_get_is_readonly 
[gw8] [ 60%] PASSED test_http_native/test.py::test_http_native_returns_timezone 
[gw2] [ 61%] PASSED test_explain_estimates/test.py::test_explain_estimates 
test_insert_distributed_async_extra_dirs/test.py::test_insert_distributed_async_send_success 
test_keeper_block_acl/test.py::test_keeper_block_acl 
[gw4] [ 62%] PASSED test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[False] 
test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[True] 
test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts 
test_inherit_multiple_profiles/test.py::test_combined_profile 
[gw5] [ 63%] PASSED test_keeper_disks/test.py::test_snapshots_with_disks 
[gw3] [ 64%] PASSED test_inherit_multiple_profiles/test.py::test_combined_profile 
test_keeper_four_word_command/test_allow_list.py::test_allow_list 
[gw7] [ 65%] PASSED test_insert_distributed_async_extra_dirs/test.py::test_insert_distributed_async_send_success 
test_keeper_compression/test_with_compression.py::test_select 
[gw2] [ 66%] PASSED test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts 
[gw4] [ 67%] PASSED test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[True] 
test_keeper_zookeeper_converter/test.py::test_smoke[False] 
[gw1] [ 68%] PASSED test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges 
test_filesystem_cache/test.py::test_keep_up_size_ratio 
[gw0] [ 69%] PASSED test_mask_sensitive_info/test.py::test_backup_to_s3 
test_mask_sensitive_info/test.py::test_create_alter_user 
test_jbod_ha/test.py::test_jbod_ha 
[gw1] [ 70%] PASSED test_filesystem_cache/test.py::test_keep_up_size_ratio 
test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node] 
[gw7] [ 71%] PASSED test_keeper_compression/test_with_compression.py::test_select 
test_keeper_nodes_move/test.py::test_node_move 
[gw3] [ 72%] PASSED test_keeper_four_word_command/test_allow_list.py::test_allow_list 
test_executable_user_defined_functions_config_reload/test.py::test 
[gw0] [ 73%] PASSED test_mask_sensitive_info/test.py::test_create_alter_user 
test_mask_sensitive_info/test.py::test_create_database 
[gw4] [ 74%] PASSED test_keeper_zookeeper_converter/test.py::test_smoke[False] 
test_keeper_zookeeper_converter/test.py::test_smoke[True] 
[gw0] [ 75%] PASSED test_mask_sensitive_info/test.py::test_create_database 
test_mask_sensitive_info/test.py::test_create_dictionary 
[gw0] [ 76%] PASSED test_mask_sensitive_info/test.py::test_create_dictionary 
test_mask_sensitive_info/test.py::test_create_table 
[gw6] [ 77%] PASSED test_keeper_internal_secure/test.py::test_secure_raft_works_with_password 
test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task 
[gw4] [ 78%] PASSED test_keeper_zookeeper_converter/test.py::test_smoke[True] 
[gw8] [ 79%] PASSED test_keeper_block_acl/test.py::test_keeper_block_acl 
[gw1] [ 80%] PASSED test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node] 
test_filesystem_cache/test.py::test_system_sync_filesystem_cache 
test_keeper_memory_soft_limit/test.py::test_soft_limit_create 
[gw1] [ 81%] PASSED test_filesystem_cache/test.py::test_system_sync_filesystem_cache 
[gw9] [ 82%] PASSED test_reload_clusters_config/test.py::test_add_cluster 
test_reload_clusters_config/test.py::test_delete_cluster 
[gw5] [ 83%] PASSED test_executable_user_defined_functions_config_reload/test.py::test 
test_keeper_mntr_pressure/test.py::test_aggressive_mntr 
[gw8] [ 84%] SKIPPED test_keeper_memory_soft_limit/test.py::test_soft_limit_create 
[gw7] [ 85%] PASSED test_keeper_nodes_move/test.py::test_node_move 
[gw2] [ 86%] PASSED test_jbod_ha/test.py::test_jbod_ha 
[gw6] [ 87%] PASSED test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task 
test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table 
test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers 
test_mutation_fetch_fallback/test.py::test_mutation_fetch_fallback 
[gw6] [ 88%] PASSED test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table 
[gw8] [ 89%] PASSED test_mutation_fetch_fallback/test.py::test_mutation_fetch_fallback 
[gw2] [ 90%] PASSED test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers 
[gw5] [ 91%] PASSED test_keeper_mntr_pressure/test.py::test_aggressive_mntr 
[gw0] [ 92%] PASSED test_mask_sensitive_info/test.py::test_create_table 
test_mask_sensitive_info/test.py::test_encryption_functions 
[gw0] [ 93%] PASSED test_mask_sensitive_info/test.py::test_encryption_functions 
test_mask_sensitive_info/test.py::test_iceberg_cluster_function 
[gw0] [ 94%] PASSED test_mask_sensitive_info/test.py::test_iceberg_cluster_function 
test_mask_sensitive_info/test.py::test_on_cluster 
[gw0] [ 95%] PASSED test_mask_sensitive_info/test.py::test_on_cluster 
test_mask_sensitive_info/test.py::test_table_function_ways_to_call 
[gw0] [ 96%] PASSED test_mask_sensitive_info/test.py::test_table_function_ways_to_call 
test_mask_sensitive_info/test.py::test_table_functions 
[gw9] [ 97%] FAILED test_reload_clusters_config/test.py::test_delete_cluster 
test_reload_clusters_config/test.py::test_simple_reload 
[gw0] [ 98%] PASSED test_mask_sensitive_info/test.py::test_table_functions 
[gw9] [ 99%] PASSED test_reload_clusters_config/test.py::test_simple_reload 
test_reload_clusters_config/test.py::test_update_one_cluster 
[gw9] [100%] FAILED test_reload_clusters_config/test.py::test_update_one_cluster 

=================================== FAILURES ===================================
_____________________________ test_delete_cluster ______________________________
[gw9] linux -- Python 3.10.12 /usr/bin/python3

started_cluster = <helpers.cluster.ClickHouseCluster object at 0x7f6c70ff4280>

    def test_delete_cluster(started_cluster):
        send_repeated_query("distributed")
        send_repeated_query("distributed2")
    
>       assert get_errors_count("test_cluster") > 0
E       AssertionError: assert 0 > 0
E        +  where 0 = get_errors_count('test_cluster')

test_reload_clusters_config/test.py:217: AssertionError
------------------------------ Captured log call -------------------------------
2025-11-13 08:47:30.649000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:47:43.498000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:47:56.499000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:48:08.797000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:48:21.150000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:48:35.150000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:48:48.151000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:49:01.154000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:49:13.406000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:49:26.159000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:49:38.408000 [ 729 ] DEBUG : Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node (cluster.py:3648, query)
___________________________ test_update_one_cluster ____________________________
[gw9] linux -- Python 3.10.12 /usr/bin/python3

started_cluster = <helpers.cluster.ClickHouseCluster object at 0x7f6c70ff4280>

    def test_update_one_cluster(started_cluster):
        send_repeated_query("distributed")
        send_repeated_query("distributed2")
    
>       assert get_errors_count("test_cluster") > 0
E       AssertionError: assert 0 > 0
E        +  where 0 = get_errors_count('test_cluster')

test_reload_clusters_config/test.py:202: AssertionError
------------------------------ Captured log call -------------------------------
2025-11-13 08:50:41.390000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:50:53.741000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:51:05.989000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:51:18.237000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:51:30.487000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:51:43.290000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:51:55.541000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:52:07.792000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:52:20.040000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:52:32.791000 [ 729 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3731, query_and_get_error)
2025-11-13 08:52:45.041000 [ 729 ] DEBUG : Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node (cluster.py:3648, query)
---------------------------- Captured log teardown -----------------------------
2025-11-13 08:52:45.261000 [ 729 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw9/.env --project-name roottestreloadclustersconfig-gw9 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw9/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop --timeout 20] (cluster.py:121, run_and_check)
2025-11-13 08:52:54.888000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-node-1  Stopping (cluster.py:147, run_and_check)
2025-11-13 08:52:54.888000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-node-1  Stopped (cluster.py:147, run_and_check)
2025-11-13 08:52:54.888000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo2-1  Stopping (cluster.py:147, run_and_check)
2025-11-13 08:52:54.888000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo3-1  Stopping (cluster.py:147, run_and_check)
2025-11-13 08:52:54.888000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo1-1  Stopping (cluster.py:147, run_and_check)
2025-11-13 08:52:54.888000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo2-1  Stopped (cluster.py:147, run_and_check)
2025-11-13 08:52:54.888000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo3-1  Stopped (cluster.py:147, run_and_check)
2025-11-13 08:52:54.888000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo1-1  Stopped (cluster.py:147, run_and_check)
2025-11-13 08:52:54.889000 [ 729 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw9/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw9/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check)
2025-11-13 08:52:54.900000 [ 729 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw9/.env --project-name roottestreloadclustersconfig-gw9 --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-0-gw9/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml down --volumes] (cluster.py:121, run_and_check)
2025-11-13 08:52:55.331000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-node-1  Stopping (cluster.py:147, run_and_check)
2025-11-13 08:52:55.331000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-node-1  Stopped (cluster.py:147, run_and_check)
2025-11-13 08:52:55.331000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-node-1  Removing (cluster.py:147, run_and_check)
2025-11-13 08:52:55.331000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-node-1  Removed (cluster.py:147, run_and_check)
2025-11-13 08:52:55.331000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo2-1  Stopping (cluster.py:147, run_and_check)
2025-11-13 08:52:55.331000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo3-1  Stopping (cluster.py:147, run_and_check)
2025-11-13 08:52:55.332000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo1-1  Stopping (cluster.py:147, run_and_check)
2025-11-13 08:52:55.332000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo2-1  Stopped (cluster.py:147, run_and_check)
2025-11-13 08:52:55.332000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo2-1  Removing (cluster.py:147, run_and_check)
2025-11-13 08:52:55.332000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo3-1  Stopped (cluster.py:147, run_and_check)
2025-11-13 08:52:55.332000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo3-1  Removing (cluster.py:147, run_and_check)
2025-11-13 08:52:55.332000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo1-1  Stopped (cluster.py:147, run_and_check)
2025-11-13 08:52:55.332000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo1-1  Removing (cluster.py:147, run_and_check)
2025-11-13 08:52:55.332000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo2-1  Removed (cluster.py:147, run_and_check)
2025-11-13 08:52:55.333000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo3-1  Removed (cluster.py:147, run_and_check)
2025-11-13 08:52:55.333000 [ 729 ] DEBUG : Stderr: Container roottestreloadclustersconfig-gw9-zoo1-1  Removed (cluster.py:147, run_and_check)
2025-11-13 08:52:55.333000 [ 729 ] DEBUG : Stderr: Network roottestreloadclustersconfig-gw9_default  Removing (cluster.py:147, run_and_check)
2025-11-13 08:52:55.333000 [ 729 ] DEBUG : Stderr: Network roottestreloadclustersconfig-gw9_default  Removed (cluster.py:147, run_and_check)
2025-11-13 08:52:55.333000 [ 729 ] DEBUG : Cleanup called (cluster.py:851, cleanup)
2025-11-13 08:52:55.358000 [ 729 ] DEBUG : Docker networks for project roottestreloadclustersconfig-gw9 are NETWORK ID   NAME      DRIVER    SCOPE
 (cluster.py:830, print_all_docker_pieces)
2025-11-13 08:52:55.378000 [ 729 ] DEBUG : Docker containers for project roottestreloadclustersconfig-gw9 are CONTAINER ID   IMAGE     COMMAND   CREATED   STATUS    PORTS     NAMES
 (cluster.py:838, print_all_docker_pieces)
2025-11-13 08:52:55.400000 [ 729 ] DEBUG : Docker volumes for project roottestreloadclustersconfig-gw9 are DRIVER    VOLUME NAME
 (cluster.py:846, print_all_docker_pieces)
2025-11-13 08:52:55.401000 [ 729 ] DEBUG : Command:[docker container list --all --filter name='^/roottestreloadclustersconfig-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check)
2025-11-13 08:52:55.419000 [ 729 ] DEBUG : Unstopped containers: {} (cluster.py:865, cleanup)
2025-11-13 08:52:55.419000 [ 729 ] DEBUG : No running containers for project: roottestreloadclustersconfig-gw9 (cluster.py:879, cleanup)
2025-11-13 08:52:55.419000 [ 729 ] DEBUG : Trying to prune unused networks... (cluster.py:885, cleanup)
2025-11-13 08:52:55.438000 [ 729 ] DEBUG : Trying to prune unused images... (cluster.py:901, cleanup)
2025-11-13 08:52:55.438000 [ 729 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check)
2025-11-13 08:52:55.468000 [ 729 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check)
2025-11-13 08:52:55.468000 [ 729 ] DEBUG : Images pruned (cluster.py:904, cleanup)
2025-11-13 08:52:55.468000 [ 729 ] DEBUG : Trying to prune unused volumes... (cluster.py:910, cleanup)
2025-11-13 08:52:55.468000 [ 729 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check)
2025-11-13 08:52:55.492000 [ 729 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check)
2025-11-13 08:52:55.493000 [ 729 ] DEBUG : Volumes pruned: 1
 (cluster.py:915, cleanup)
----------------- generated report log file: parallel1_0.jsonl -----------------
============================== slowest durations ===============================
138.95s call     test_reload_clusters_config/test.py::test_add_cluster
127.97s call     test_reload_clusters_config/test.py::test_delete_cluster
123.87s call     test_reload_clusters_config/test.py::test_update_one_cluster
109.95s call     test_mask_sensitive_info/test.py::test_create_table
69.02s setup    test_mask_sensitive_info/test.py::test_backup_table
66.31s call     test_keeper_internal_secure/test.py::test_secure_raft_works_with_password
62.70s call     test_reload_clusters_config/test.py::test_simple_reload
61.96s call     test_keeper_mntr_pressure/test.py::test_aggressive_mntr
61.88s call     test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges
60.31s call     test_mask_sensitive_info/test.py::test_table_functions
54.78s call     test_mask_sensitive_info/test.py::test_backup_to_s3
40.91s call     test_keeper_block_acl/test.py::test_keeper_block_acl
35.73s call     test_jbod_ha/test.py::test_jbod_ha
32.46s call     test_keeper_nodes_move/test.py::test_node_move
28.06s teardown test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout
27.10s setup    test_reload_clusters_config/test.py::test_add_cluster
26.85s call     test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]
26.05s call     test_keeper_disks/test.py::test_snapshots_with_disks
25.76s call     test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task
24.12s call     test_keeper_disks/test.py::test_logs_with_disks
23.83s call     test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table
22.85s setup    test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]
22.84s call     test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[True]
22.62s call     test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]
22.18s teardown test_keeper_disks/test.py::test_snapshots_with_disks
22.17s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]
22.11s call     test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[True]
21.49s call     test_executable_user_defined_functions_config_reload/test.py::test
21.45s setup    test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers
19.91s teardown test_mutation_fetch_fallback/test.py::test_mutation_fetch_fallback
19.54s call     test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection
19.37s call     test_quorum_inserts/test.py::test_insert_quorum_with_ttl
19.35s call     test_keeper_zookeeper_converter/test.py::test_smoke[True]
19.19s call     test_filesystem_cache/test.py::test_custom_cached_disk
19.19s setup    test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum
19.17s call     test_keeper_internal_secure/test.py::test_secure_raft_works
18.54s setup    test_keeper_memory_soft_limit/test.py::test_soft_limit_create
18.11s teardown test_quorum_inserts/test.py::test_simple_add_replica
17.89s call     test_mask_sensitive_info/test.py::test_table_function_ways_to_call
17.55s call     test_mask_sensitive_info/test.py::test_iceberg_cluster_function
17.37s call     test_keeper_zookeeper_converter/test.py::test_acls[True]
17.15s setup    test_jbod_ha/test.py::test_jbod_ha
16.83s setup    test_executable_user_defined_functions_config_reload/test.py::test
16.72s setup    test_keeper_block_acl/test.py::test_keeper_block_acl
16.12s setup    test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts
15.35s teardown test_keeper_memory_soft_limit/test.py::test_soft_limit_create
15.32s teardown test_mask_sensitive_info/test.py::test_table_functions
15.28s setup    test_keeper_zookeeper_converter/test.py::test_acls[False]
15.27s call     test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[False]
15.22s setup    test_keeper_four_word_command/test_allow_list.py::test_allow_list
15.21s setup    test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node2]
14.62s setup    test_keeper_disks/test.py::test_logs_with_disks
14.53s setup    test_keeper_session/test.py::test_session_close_shutdown
14.41s setup    test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]
14.36s setup    test_keeper_mntr_pressure/test.py::test_aggressive_mntr
14.27s setup    test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used
14.25s setup    test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard
14.17s setup    test_keeper_internal_secure/test.py::test_secure_raft_works
13.65s call     test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[False]
13.29s call     test_keeper_session/test.py::test_session_close_shutdown
13.27s setup    test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task
13.26s setup    test_keeper_nodes_move/test.py::test_node_move
13.21s setup    test_external_http_authenticator/test.py::test_basic_auth_failed
13.12s setup    test_hot_reload_storage_policy/test.py::test_hot_reload_policy
13.10s setup    test_keeper_compression/test_with_compression.py::test_select
13.02s setup    test_insert_distributed_async_extra_dirs/test.py::test_insert_distributed_async_send_success
13.02s setup    test_explain_estimates/test.py::test_explain_estimates
12.96s setup    test_grpc_protocol_ssl/test.py::test_insecure_channel
12.90s call     test_keeper_zookeeper_converter/test.py::test_acls[False]
12.75s call     test_keeper_zookeeper_converter/test.py::test_smoke[False]
12.65s call     test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers
12.05s teardown test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts
11.72s call     test_hot_reload_storage_policy/test.py::test_hot_reload_policy_distributed_table
11.09s setup    test_http_and_readonly/test.py::test_http_get_is_readonly
11.08s setup    test_external_cluster/test.py::test_ddl
10.37s call     test_keeper_persistent_log/test.py::test_state_duplicate_restart
10.37s setup    test_http_native/test.py::test_http_native_returns_timezone
10.25s setup    test_mutation_fetch_fallback/test.py::test_mutation_fetch_fallback
10.23s teardown test_reload_clusters_config/test.py::test_update_one_cluster
10.17s setup    test_filesystem_cache/test.py::test_custom_cached_disk
8.88s teardown test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table
8.24s setup    test_keeper_persistent_log/test.py::test_ephemeral_after_restart
7.96s call     test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum
6.81s teardown test_grpc_protocol_ssl/test.py::test_wrong_client_certificate
6.64s call     test_mutation_fetch_fallback/test.py::test_mutation_fetch_fallback
6.62s call     test_mask_sensitive_info/test.py::test_encryption_functions
6.57s call     test_filesystem_cache/test.py::test_dynamic_resize
6.25s call     test_filesystem_cache/test.py::test_keep_up_size_ratio
6.22s call     test_insert_distributed_async_extra_dirs/test.py::test_insert_distributed_async_send_success
6.06s call     test_filesystem_cache/test.py::test_system_sync_filesystem_cache
5.74s teardown test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers
5.58s call     test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]
5.08s teardown test_filesystem_cache/test.py::test_system_sync_filesystem_cache
4.86s call     test_mask_sensitive_info/test.py::test_create_alter_user
4.80s call     test_external_http_authenticator/test.py::test_session_settings_from_auth_response
4.70s setup    test_inherit_multiple_profiles/test.py::test_combined_profile
4.48s call     test_keeper_persistent_log/test.py::test_ephemeral_after_restart
4.46s call     test_keeper_persistent_log/test.py::test_state_after_restart
4.41s call     test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True]
4.40s teardown test_external_http_authenticator/test.py::test_user_from_config_basic_auth_pass
4.38s teardown test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin
4.22s teardown test_external_cluster/test.py::test_ddl_replicated
3.99s call     test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False]
3.96s call     test_quorum_inserts/test.py::test_simple_add_replica
3.93s call     test_mask_sensitive_info/test.py::test_create_database
3.86s teardown test_inherit_multiple_profiles/test.py::test_combined_profile
3.64s call     test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True]
3.39s call     test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format
3.38s call     test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False]
3.36s teardown test_http_native/test.py::test_http_native_returns_timezone
3.27s call     test_mask_sensitive_info/test.py::test_create_dictionary
3.20s call     test_hot_reload_storage_policy/test.py::test_hot_reload_policy
3.04s teardown test_explain_estimates/test.py::test_explain_estimates
3.03s call     test_filesystem_cache/test.py::test_filesystem_cache_log
3.01s call     test_external_cluster/test.py::test_ddl
2.86s call     test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]
2.67s call     test_insert_into_distributed_sync_async/test.py::test_insertion_sync
2.55s call     test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]
2.55s call     test_mask_sensitive_info/test.py::test_on_cluster
2.51s call     test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]
2.32s teardown test_http_and_readonly/test.py::test_http_get_is_readonly
2.32s call     test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout
2.31s call     test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts
2.30s teardown test_keeper_block_acl/test.py::test_keeper_block_acl
2.29s teardown test_jbod_ha/test.py::test_jbod_ha
2.03s call     test_grpc_protocol_ssl/test.py::test_insecure_channel
2.03s call     test_mask_sensitive_info/test.py::test_backup_table_AzureBlobStorage
2.00s call     test_grpc_protocol_ssl/test.py::test_wrong_client_certificate
1.99s call     test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard
1.74s teardown test_keeper_nodes_move/test.py::test_node_move
1.72s call     test_keeper_four_word_command/test_allow_list.py::test_allow_list
1.70s teardown test_keeper_four_word_command/test_allow_list.py::test_allow_list
1.66s call     test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes
1.66s teardown test_keeper_internal_secure/test.py::test_secure_raft_works_with_password
1.61s teardown test_keeper_mntr_pressure/test.py::test_aggressive_mntr
1.55s teardown test_keeper_session/test.py::test_session_timeout
1.52s call     test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout
1.50s call     test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk
1.45s teardown test_keeper_compression/test_with_compression.py::test_select
1.44s teardown test_keeper_persistent_log/test.py::test_state_duplicate_restart
1.42s teardown test_keeper_zookeeper_converter/test.py::test_smoke[True]
1.38s call     test_inherit_multiple_profiles/test.py::test_combined_profile
1.35s teardown test_hot_reload_storage_policy/test.py::test_hot_reload_policy_distributed_table
1.28s call     test_mask_sensitive_info/test.py::test_backup_table
1.24s call     test_explain_estimates/test.py::test_explain_estimates
1.21s teardown test_insert_distributed_async_extra_dirs/test.py::test_insert_distributed_async_send_success
1.13s teardown test_executable_user_defined_functions_config_reload/test.py::test
1.12s teardown test_filesystem_cache/test.py::test_custom_cached_disk
1.02s call     test_external_http_authenticator/test.py::test_user_create_basic_auth_pass
1.02s call     test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout
1.00s call     test_external_cluster/test.py::test_ddl_replicated
0.90s call     test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin
0.85s call     test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used
0.43s call     test_external_http_authenticator/test.py::test_user_from_config_basic_auth_pass
0.37s call     test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node2]
0.37s call     test_keeper_session/test.py::test_session_timeout
0.33s call     test_external_http_authenticator/test.py::test_basic_auth_failed
0.32s call     test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node2]
0.32s call     test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node1]
0.32s call     test_keeper_compression/test_with_compression.py::test_select
0.32s call     test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node1]
0.32s call     test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node2]
0.27s call     test_keeper_memory_soft_limit/test.py::test_soft_limit_create
0.23s call     test_grpc_protocol_ssl/test.py::test_secure_channel
0.10s call     test_http_and_readonly/test.py::test_http_get_is_readonly
0.10s call     test_external_http_authenticator/test.py::test_header_failed
0.08s call     test_http_native/test.py::test_http_native_returns_timezone
0.00s teardown test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[True]
0.00s teardown test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[False]
0.00s teardown test_keeper_persistent_log/test.py::test_state_after_restart
0.00s teardown test_keeper_zookeeper_converter/test.py::test_acls[True]
0.00s teardown test_keeper_internal_secure/test.py::test_secure_raft_works
0.00s teardown test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[True]
0.00s teardown test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[False]
0.00s setup    test_keeper_session/test.py::test_session_timeout
0.00s setup    test_keeper_persistent_log/test.py::test_state_duplicate_restart
0.00s teardown test_keeper_persistent_log/test.py::test_ephemeral_after_restart
0.00s setup    test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[False]
0.00s teardown test_keeper_zookeeper_converter/test.py::test_smoke[False]
0.00s setup    test_grpc_protocol_ssl/test.py::test_wrong_client_certificate
0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]
0.00s teardown test_keeper_zookeeper_converter/test.py::test_acls[False]
0.00s teardown test_keeper_disks/test.py::test_logs_with_disks
0.00s setup    test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[True]
0.00s setup    test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk
0.00s teardown test_mask_sensitive_info/test.py::test_iceberg_cluster_function
0.00s teardown test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum
0.00s setup    test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False]
0.00s setup    test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[True]
0.00s setup    test_reload_clusters_config/test.py::test_delete_cluster
0.00s setup    test_keeper_zookeeper_converter/test.py::test_smoke[False]
0.00s setup    test_keeper_disks/test.py::test_snapshots_with_disks
0.00s setup    test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node2]
0.00s teardown test_mask_sensitive_info/test.py::test_backup_table
0.00s teardown test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]
0.00s teardown test_mask_sensitive_info/test.py::test_create_dictionary
0.00s setup    test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node1]
0.00s setup    test_mask_sensitive_info/test.py::test_create_alter_user
0.00s setup    test_mask_sensitive_info/test.py::test_on_cluster
0.00s teardown test_reload_clusters_config/test.py::test_add_cluster
0.00s setup    test_keeper_persistent_log/test.py::test_state_after_restart
0.00s setup    test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]
0.00s setup    test_quorum_inserts/test.py::test_simple_add_replica
0.00s setup    test_keeper_internal_secure/test.py::test_secure_raft_works_with_password
0.00s teardown test_keeper_session/test.py::test_session_close_shutdown
0.00s setup    test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node1]
0.00s setup    test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]
0.00s setup    test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]
0.00s setup    test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin
0.00s setup    test_filesystem_cache/test.py::test_keep_up_size_ratio
0.00s setup    test_filesystem_cache/test.py::test_system_sync_filesystem_cache
0.00s teardown test_external_cluster/test.py::test_ddl
0.00s setup    test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node2]
0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node2]
0.00s teardown test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used
0.00s setup    test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]
0.00s teardown test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]
0.00s teardown test_mask_sensitive_info/test.py::test_create_table
0.00s teardown test_grpc_protocol_ssl/test.py::test_insecure_channel
0.00s setup    test_grpc_protocol_ssl/test.py::test_secure_channel
0.00s setup    test_keeper_zookeeper_converter/test.py::test_smoke[True]
0.00s setup    test_keeper_zookeeper_converter/test.py::test_acls[True]
0.00s setup    test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False]
0.00s setup    test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes
0.00s setup    test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True]
0.00s setup    test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]
0.00s setup    test_mask_sensitive_info/test.py::test_backup_table_AzureBlobStorage
0.00s teardown test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task
0.00s setup    test_hot_reload_storage_policy/test.py::test_hot_reload_policy_distributed_table
0.00s teardown test_mask_sensitive_info/test.py::test_on_cluster
0.00s teardown test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes
0.00s setup    test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]
0.00s teardown test_external_http_authenticator/test.py::test_basic_auth_failed
0.00s setup    test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[False]
0.00s teardown test_mask_sensitive_info/test.py::test_backup_to_s3
0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection
0.00s setup    test_external_http_authenticator/test.py::test_user_create_basic_auth_pass
0.00s teardown test_mask_sensitive_info/test.py::test_encryption_functions
0.00s setup    test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout
0.00s setup    test_filesystem_cache/test.py::test_dynamic_resize
0.00s setup    test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True]
0.00s setup    test_mask_sensitive_info/test.py::test_iceberg_cluster_function
0.00s setup    test_mask_sensitive_info/test.py::test_table_function_ways_to_call
0.00s teardown test_filesystem_cache/test.py::test_filesystem_cache_log
0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node2]
0.00s setup    test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection
0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format
0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False]
0.00s setup    test_external_http_authenticator/test.py::test_header_failed
0.00s setup    test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table
0.00s setup    test_quorum_inserts/test.py::test_insert_quorum_with_ttl
0.00s teardown test_external_http_authenticator/test.py::test_session_settings_from_auth_response
0.00s teardown test_filesystem_cache/test.py::test_keep_up_size_ratio
0.00s setup    test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges
0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node1]
0.00s setup    test_mask_sensitive_info/test.py::test_backup_to_s3
0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True]
0.00s setup    test_mask_sensitive_info/test.py::test_table_functions
0.00s setup    test_mask_sensitive_info/test.py::test_encryption_functions
0.00s teardown test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout
0.00s setup    test_mask_sensitive_info/test.py::test_create_dictionary
0.00s setup    test_mask_sensitive_info/test.py::test_create_table
0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node1]
0.00s teardown test_hot_reload_storage_policy/test.py::test_hot_reload_policy
0.00s setup    test_reload_clusters_config/test.py::test_simple_reload
0.00s setup    test_mask_sensitive_info/test.py::test_create_database
0.00s teardown test_mask_sensitive_info/test.py::test_create_database
0.00s teardown test_insert_into_distributed_sync_async/test.py::test_insertion_sync
0.00s setup    test_insert_into_distributed_sync_async/test.py::test_insertion_sync
0.00s setup    test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout
0.00s setup    test_external_cluster/test.py::test_ddl_replicated
0.00s teardown test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges
0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_ttl
0.00s teardown test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard
0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node2]
0.00s teardown test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk
0.00s teardown test_mask_sensitive_info/test.py::test_table_function_ways_to_call
0.00s setup    test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout
0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True]
0.00s setup    test_reload_clusters_config/test.py::test_update_one_cluster
0.00s teardown test_grpc_protocol_ssl/test.py::test_secure_channel
0.00s teardown test_mask_sensitive_info/test.py::test_create_alter_user
0.00s teardown test_reload_clusters_config/test.py::test_delete_cluster
0.00s setup    test_external_http_authenticator/test.py::test_user_from_config_basic_auth_pass
0.00s setup    test_external_http_authenticator/test.py::test_session_settings_from_auth_response
0.00s teardown test_mask_sensitive_info/test.py::test_backup_table_AzureBlobStorage
0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False]
0.00s teardown test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout
0.00s setup    test_filesystem_cache/test.py::test_filesystem_cache_log
0.00s setup    test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format
0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]
0.00s teardown test_reload_clusters_config/test.py::test_simple_reload
0.00s teardown test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]
0.00s teardown test_external_http_authenticator/test.py::test_user_create_basic_auth_pass
0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]
0.00s teardown test_filesystem_cache/test.py::test_dynamic_resize
0.00s teardown test_external_http_authenticator/test.py::test_header_failed
0.00s call     test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]
0.00s call     test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]
0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]
=========================== short test summary info ============================
FAILED test_reload_clusters_config/test.py::test_delete_cluster - AssertionEr...
FAILED test_reload_clusters_config/test.py::test_update_one_cluster - Asserti...
PASSED test_external_http_authenticator/test.py::test_basic_auth_failed
PASSED test_external_http_authenticator/test.py::test_header_failed
PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used
PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node2]
PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node1]
PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node2]
PASSED test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard
PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node1]
PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes
PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node2]
PASSED test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]
PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk
PASSED test_external_http_authenticator/test.py::test_session_settings_from_auth_response
PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync
PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin
PASSED test_external_http_authenticator/test.py::test_user_create_basic_auth_pass
PASSED test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]
PASSED test_external_http_authenticator/test.py::test_user_from_config_basic_auth_pass
PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout
PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout
PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout
PASSED test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum
PASSED test_keeper_zookeeper_converter/test.py::test_acls[False]
PASSED test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False]
PASSED test_grpc_protocol_ssl/test.py::test_insecure_channel
PASSED test_grpc_protocol_ssl/test.py::test_secure_channel
PASSED test_grpc_protocol_ssl/test.py::test_wrong_client_certificate
PASSED test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True]
PASSED test_keeper_persistent_log/test.py::test_ephemeral_after_restart
PASSED test_external_cluster/test.py::test_ddl
PASSED test_external_cluster/test.py::test_ddl_replicated
PASSED test_keeper_persistent_log/test.py::test_state_after_restart
PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]
PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]
PASSED test_keeper_zookeeper_converter/test.py::test_acls[True]
PASSED test_filesystem_cache/test.py::test_custom_cached_disk
PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format
PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]
PASSED test_keeper_persistent_log/test.py::test_state_duplicate_restart
PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]
PASSED test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection
PASSED test_filesystem_cache/test.py::test_dynamic_resize
PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]
PASSED test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False]
PASSED test_filesystem_cache/test.py::test_filesystem_cache_log
PASSED test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[False]
PASSED test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True]
PASSED test_hot_reload_storage_policy/test.py::test_hot_reload_policy
PASSED test_mask_sensitive_info/test.py::test_backup_table
PASSED test_mask_sensitive_info/test.py::test_backup_table_AzureBlobStorage
PASSED test_keeper_internal_secure/test.py::test_secure_raft_works
PASSED test_hot_reload_storage_policy/test.py::test_hot_reload_policy_distributed_table
PASSED test_keeper_session/test.py::test_session_close_shutdown
PASSED test_keeper_session/test.py::test_session_timeout
PASSED test_quorum_inserts/test.py::test_insert_quorum_with_ttl
PASSED test_keeper_disks/test.py::test_logs_with_disks
PASSED test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[True]
PASSED test_quorum_inserts/test.py::test_simple_add_replica
PASSED test_http_and_readonly/test.py::test_http_get_is_readonly
PASSED test_http_native/test.py::test_http_native_returns_timezone
PASSED test_explain_estimates/test.py::test_explain_estimates
PASSED test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[False]
PASSED test_keeper_disks/test.py::test_snapshots_with_disks
PASSED test_inherit_multiple_profiles/test.py::test_combined_profile
PASSED test_insert_distributed_async_extra_dirs/test.py::test_insert_distributed_async_send_success
PASSED test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts
PASSED test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[True]
PASSED test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges
PASSED test_mask_sensitive_info/test.py::test_backup_to_s3
PASSED test_filesystem_cache/test.py::test_keep_up_size_ratio
PASSED test_keeper_compression/test_with_compression.py::test_select
PASSED test_keeper_four_word_command/test_allow_list.py::test_allow_list
PASSED test_mask_sensitive_info/test.py::test_create_alter_user
PASSED test_keeper_zookeeper_converter/test.py::test_smoke[False]
PASSED test_mask_sensitive_info/test.py::test_create_database
PASSED test_mask_sensitive_info/test.py::test_create_dictionary
PASSED test_keeper_internal_secure/test.py::test_secure_raft_works_with_password
PASSED test_keeper_zookeeper_converter/test.py::test_smoke[True]
PASSED test_keeper_block_acl/test.py::test_keeper_block_acl
PASSED test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]
PASSED test_filesystem_cache/test.py::test_system_sync_filesystem_cache
PASSED test_reload_clusters_config/test.py::test_add_cluster
PASSED test_executable_user_defined_functions_config_reload/test.py::test
PASSED test_keeper_nodes_move/test.py::test_node_move
PASSED test_jbod_ha/test.py::test_jbod_ha
PASSED test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task
PASSED test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table
PASSED test_mutation_fetch_fallback/test.py::test_mutation_fetch_fallback
PASSED test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers
PASSED test_keeper_mntr_pressure/test.py::test_aggressive_mntr
PASSED test_mask_sensitive_info/test.py::test_create_table
PASSED test_mask_sensitive_info/test.py::test_encryption_functions
PASSED test_mask_sensitive_info/test.py::test_iceberg_cluster_function
PASSED test_mask_sensitive_info/test.py::test_on_cluster
PASSED test_mask_sensitive_info/test.py::test_table_function_ways_to_call
PASSED test_mask_sensitive_info/test.py::test_table_functions
PASSED test_reload_clusters_config/test.py::test_simple_reload
SKIPPED [1] test_keeper_memory_soft_limit/test.py:46: Disabled for sanitizers
============= 2 failed, 97 passed, 1 skipped in 493.25s (0:08:13) ==============
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 492, in <module>
    subprocess.check_call(cmd, shell=True, bufsize=0)
  File "/usr/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command 'docker run   --rm --name clickhouse_integration_tests_5uemno --privileged --dns-search='.' --memory=30709026816 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf   -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600  -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10  -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel1_0.jsonl --report-log-exclude-logs-on-passed-tests 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node2]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node1]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node2]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node1]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node2]' test_executable_user_defined_functions_config_reload/test.py::test test_explain_estimates/test.py::test_explain_estimates test_external_cluster/test.py::test_ddl test_external_cluster/test.py::test_ddl_replicated test_external_http_authenticator/test.py::test_basic_auth_failed test_external_http_authenticator/test.py::test_header_failed test_external_http_authenticator/test.py::test_session_settings_from_auth_response test_external_http_authenticator/test.py::test_user_create_basic_auth_pass test_external_http_authenticator/test.py::test_user_from_config_basic_auth_pass test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]' 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]' test_filesystem_cache/test.py::test_custom_cached_disk test_filesystem_cache/test.py::test_dynamic_resize test_filesystem_cache/test.py::test_filesystem_cache_log test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges test_filesystem_cache/test.py::test_keep_up_size_ratio 'test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]' test_filesystem_cache/test.py::test_system_sync_filesystem_cache test_grpc_protocol_ssl/test.py::test_insecure_channel test_grpc_protocol_ssl/test.py::test_secure_channel test_grpc_protocol_ssl/test.py::test_wrong_client_certificate test_hot_reload_storage_policy/test.py::test_hot_reload_policy test_hot_reload_storage_policy/test.py::test_hot_reload_policy_distributed_table test_http_and_readonly/test.py::test_http_get_is_readonly test_http_native/test.py::test_http_native_returns_timezone test_inherit_multiple_profiles/test.py::test_combined_profile test_insert_distributed_async_extra_dirs/test.py::test_insert_distributed_async_send_success test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard test_insert_into_distributed_sync_async/test.py::test_insertion_sync test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout test_jbod_ha/test.py::test_jbod_ha test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin test_keeper_block_acl/test.py::test_keeper_block_acl test_keeper_compression/test_with_compression.py::test_select test_keeper_disks/test.py::test_logs_with_disks test_keeper_disks/test.py::test_snapshots_with_disks test_keeper_four_word_command/test_allow_list.py::test_allow_list test_keeper_internal_secure/test.py::test_secure_raft_works test_keeper_internal_secure/test.py::test_secure_raft_works_with_password test_keeper_memory_soft_limit/test.py::test_soft_limit_create test_keeper_mntr_pressure/test.py::test_aggressive_mntr test_keeper_nodes_move/test.py::test_node_move test_keeper_persistent_log/test.py::test_ephemeral_after_restart test_keeper_persistent_log/test.py::test_state_after_restart test_keeper_persistent_log/test.py::test_state_duplicate_restart test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout 'test_keeper_zookeeper_converter/test.py::test_acls[False]' 'test_keeper_zookeeper_converter/test.py::test_acls[True]' 'test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[False]' 'test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[True]' 'test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[False]' 'test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[True]' 'test_keeper_zookeeper_converter/test.py::test_smoke[False]' 'test_keeper_zookeeper_converter/test.py::test_smoke[True]' test_mask_sensitive_info/test.py::test_backup_table test_mask_sensitive_info/test.py::test_backup_table_AzureBlobStorage test_mask_sensitive_info/test.py::test_backup_to_s3 test_mask_sensitive_info/test.py::test_create_alter_user test_mask_sensitive_info/test.py::test_create_database test_mask_sensitive_info/test.py::test_create_dictionary test_mask_sensitive_info/test.py::test_create_table test_mask_sensitive_info/test.py::test_encryption_functions test_mask_sensitive_info/test.py::test_iceberg_cluster_function test_mask_sensitive_info/test.py::test_on_cluster test_mask_sensitive_info/test.py::test_table_function_ways_to_call test_mask_sensitive_info/test.py::test_table_functions test_mutation_fetch_fallback/test.py::test_mutation_fetch_fallback test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_ttl test_quorum_inserts/test.py::test_simple_add_replica test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]'  -vvv " altinityinfra/integration-tests-runner:226bfaf75ac1 ' returned non-zero exit status 1.